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Abstract — In this paper we concentrate on rate- 1/3 systematic 
parallel concatenated convolutional codes and their rate- 1/2 
punctured child codes. Assuming maximum-likelihood decoding 
over an additive white Gaussian channel, we demonstrate that a 
rate-1/2 non-systematic child code can exhibit a lower error floor 
than that of its rate-1/3 parent code, if a particular condition 
is met. However, assuming iterative decoding, convergence 
of the non-systematic code towards low bit-error rates is 
problematic. To alleviate this problem, we propose rate-1/2 
partially-systematic codes that can still achieve a lower error floor 
than that of their rate-1/3 parent codes. Results obtained from 
extrinsic information transfer charts and simulations support our 
conclusion. 

I. Introduction 

A punctured convolutional code is obtained by the periodic 
elimination of symbols from the output of a low-rate parent 
convolutional code. Extensive analyses on the structure and 
performance of punctured convolutional codes has shown that 
their performance is always inferior than the performance of 
their low-rate parent codes (e.g. see [1], [2]). 

The performance of punctured parallel concatenated 
convolutional codes (PCCCs), also known as punctured turbo 
codes, has also been investigated. Design considerations have 
been derived by analytical [3]-[5] as well as simulation-based 
approaches [6]-[8], while upper bounds to the bit error 
probability (BEP) were evaluated in [5], [9]. The most recent 
papers [7]-[9] demonstrate that puncturing both systematic 
and parity outputs of a rate-1/3 turbo code results in better 
high-rate turbo codes, in terms of BEP performance, than 
puncturing only the parity outputs of the original turbo code. 

The aim of this paper is to explore whether rate-1/2 
punctured turbo codes can eventually achieve better 
performance than their parent rate-1/3 systematic turbo codes 
on additive white Gaussian (AWGN) channels. Assuming 
maximum-likelihood (ML) decoding, we demonstrate that, 
contrary to punctured convolutional codes, punctured turbo 
codes yielding lower error floors than that of their parent 
code can be constructed. Nevertheless, we cannot be 
conclusive when suboptimal iterative decoding is used. For 
this reason, we also study the convergence behavior of iterative 
decoding and we investigate whether the performance of the 
proposed rate-1/2 punctured turbo codes converges towards the 
theoretical error floor, at low bit error probabilities. 
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II. Performance Evaluation of 
Rate-1/3 Turbo Codes 

Turbo codes, in the form of symmetric rate-1/3 PCCCs, 
consist of two identical rate-1/2 recursive systematic 
convolutional encoders separated by an interleaver of size N 
[10]. The information bits are input to the first constituent 
convolutional encoder, while an interleaved version of the 
information bits are input to the second convolutional encoder. 
The output of the turbo encoder consists of the systematic bits 
of the first encoder, which are identical to the information bits, 
the parity check bits of the first encoder and the parity check 
bits of the second encoder. 

It was shown in [11] and [12] that the performance of 
a PCCC can be obtained from the input-redundancy weight 
enumerating functions (IRWEFs) of the terminated constituent 
recursive convolutional codes. The IRWEF for the case of a 
convolutional code C assumes the form 



(1) 



where A c w j denotes the number of codeword sequences having 
parity check weight j, which were generated by an input 
sequence of weight w. The overall output weight of the 
codeword sequence, for the case of a systematic code, is w+j. 

The conditional weight enumerating function (CWEF), 
A c (w,Z), provides all codeword sequences generated by an 
input sequence of weight w. Consequently, the relationship 
between the CWEF and the IRWEF is 



A C (W,Z) = ^A c {w,Z)W % 



(2) 



A relationship between the CWEF of a PCCC, V, and the 
CWEF of C, which is one of the two identical constituent 
codes, can be easily derived only if we assume the use 
of a uniform interleaver, an abstract probabilistic concept 
introduced in [12]. In particular, if N is the size of the uniform 
interleaver and A c (w, Z) is the CWEF of the constituent code, 
the CWEF of the PCCC, A v (w, Z), is equal to 



A v {w,Z) 



[A c {w,Z)\ 



N 



(3) 



The IRWEF of V, A V (W, Z), can be then computed from the 
CWEF, A p (w, Z), in a manner identical to (|2). 

The input-output weight enumerating function (IOWEF) 
provides the number of codeword sequences generated by 
an input sequence of weight w, whose overall output weight 
is d, in contrast with the IRWEF, which only considers the 
output parity check weight j. If V is a systematic PCCC, the 
corresponding IOWEF assumes the form 

B V (W, !>)=££ BZ, d W w D d , (4) 

W d 

where the coefficients B^ d can be derived from the 
coefficients z of the IRWEF, based on the expressions 

b Za = A Z,j> and d = w + j. (5) 

The IOWEF coefficients d can be used to determine a 
tight upper bound on the BEP for ML soft decoding for the 
case of an AWGN channel, as follows 

where R-p is the rate of the turbo code, which in our case is 
equal to 1/3. The upper bound can be rewritten as 

^<$]i», (7) 

w 

where P(w) is the contribution to the overall BEP of all error 
events having information weight w, and is defined as 

Benedetto et al. showed in [12] that the upper bound on 
the BEP of a PCCC using a uniform interleaver of size N 
coincides with the average of the upper bounds obtainable 
from the whole class of deterministic interleavers of size N. 
For small values of N, the upper bound can be very loose 
compared with the actual performance of turbo codes using 
specific deterministic interleavers. However, for N > 1000, 
it has been observed that randomly generated interleavers 
generally perform better than deterministic interleaver designs 
[13]. Consequently, the upper bound provides a good 
indication of the actual error rate performance of a PCCC, 
when long interleavers are considered. 

III. Performance Evaluation of 
Rate- 1/2 Punctured Non-Systematic PCCCs 

Rates higher than 1/3 can be achieved by puncturing 
the output of a rate- 1/3 turbo encoder. Punctured codes 
are classified as systematic (S), partially systematic (PS) or 
non-systematic (NS) depending on whether all, some or none 
of their systematic bits are transmitted [7]. In this section 
we concentrate specifically on rate- 1/2 NS-PCCCs, because 
their weight enumerating functions can be easily related to 
the weight enumerating functions of their parent codes, as it 
will now be demonstrated. 



A symmetric rate- 1/2 NS-PCCC, T", can be obtained by 
puncturing the systematic output of a rate- 1/3 PCCC, V, 
which consists of two identical rate- 1/2 recursive systematic 
convolutional codes. However, V can also be seen as a 
PCCC constructed using two identical rate-1 non-systematic 
convolutional codes, each one of which has been obtained 
by puncturing the systematic bits of a rate- 1/2 systematic 
convolutional code, identical to the one used in V. If C is 
the punctured rate-1 non-systematic convolutional code and 
C is the parent rate- 1/2 systematic convolutional code, their 
IRWEFs, A c ' (W, Z) and A C (W, Z) respectively, are identical, 
i.e., 

A C '(W,Z) = A C (W,Z), (9) 

since, by definition, the IRWEF does not provide information 
about the weight of the systematic bits of a codeword. Thus, 
puncturing of the systematic bits of C will not cause any 
change in its IRWEF. 

Either by applying the same reasoning or by considering (ffji 
and ©, we find that the IRWEF of the rate- 1/2 NS-PCCC, 
A V '(W,Z), is identical to the IRWEF of its parent code, 
A V (W,Z), i.e., 

A V '{W,Z) = A V (W,Z). (10) 

Puncturing has an effect only when calculating the IOWEF 
of 7?', B V '{W,D). We use the notation d' to denote the overall 
weight of a codeword sequence after puncturing as opposed 
to d, which refers to the overall weight of the same codeword 
sequence before puncturing. Therefore the IOWEF of V' can 
be expressed as 

B v '(W,D)=Y /Z Z<d'W w D d '. (11) 

to d' 

Since all systematic bits are punctured, the weight w of the 
information bits does not contribute to the overall weight d' of 
the punctured codeword sequences, and hence it follows that 

Bl[ d ,=AZj, and d' = j. (12) 

From (O and ( fl~2T > we find that the relationship between the 
IOWEF coefficients, B% d , and B^ d , is as follows 

Bw,d' = B w,(d'+w) or B w,(d-w) — B w,d (13) 

since 

d = d' + w. (14) 

This is equivalent to saying that if all information sequences of 
weight w are input to both V and V', the overall weight of the 
generated codeword sequences follows the same distribution 
in both cases, but is shifted by w in the case of V '. 

The upper bound on the BEP for ML soft decoding for the 
case of an AWGN channel takes the form 

w 

where P'{w) is given by 

'C'-I^'tl/^) <16) 



and R-pi — 1/2. Taking into account ( fT~3b and ( fT4t . we can 
rewrite ( [ToT l as a function of d and Bf u d , as follows 



p, H = E 



N 



(d-w) 



(17) 



IV. Performance Analysis 

Before continuing to the derivation of a condition which 
needs to be met so that a rate- 1/2 NS-PCCC can achieve 
a better ML bound than its parent rate- 1/3 PCCC, we first 
enumerate a number of results, derived and justified in [14]: 

1) The minimum information weight for recursive 
convolutional encoders is w m [ n = 2. 

2) For recursive constituent codes and long interleaves, the 
contribution to the overall BEP of all error events with 
odd information weight is negligible. Furthermore, as the 
interleaver size increases, the contribution to the overall 
BEP of all error events with information weight is 
dominant. 

3) The upper bound of a PCCC which uses recursive 
constituent codes, depends on its free effective distance 
rffree.eff, which corresponds to the minimum overall output 
weight when the information weight is w m i n . 

It is also straightforward to verify that, although puncturing of 
the systematic bits of a rate- 1/3 PCCC affects the upper bound 
on the BEP, the previously highlighted trends still apply. 

Based on © and <Q3), the rate- 1/2 NS-PCCC, V, will 
achieve a better bound than its parent, if 



^ p'{w) < p ( w )- 



w>2 



(18) 



w>2 



For large interleaver sizes, the dominant terms will be P'(2) 
and P(2), thus dTHJ reduces to P'(2) < P(2), or equivalently 

Q(f'(d))< ( 19 ) 
where f f (d) and f(d) are defined as 



E 



/(<*> 



Nn 



(20) 



according to (0 and H7i . 

Function C](£) is a monotonically decreasing function of £, 
where £ is a real number. Consequently, if £i and £2 are real 
numbers with £1 > £ 2 i it follows that Q(£i) < Qfe), an d 
vice versa, i.e, 

Q(6) < >6- (2D 

Therefore, inequality ( fT9] i is satisfied if 

f'{d) > /(d), for every d > d fKe . eS . (22) 

Both f'(d) and f(d) are monotonically increasing functions, 
therefore d22"l > holds true if only f'(df lee . e ff) > /(df ree .eff), or 

2R V , 



dfree.eff > 



R-pi — Rj> 



(23) 
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Fig. 1. Upper bounds and contributions to the BEP of all error events 
with information weight of 2 and 3, for the rate-1/2 NS-PCCC(l,5/7,5/7) 
and its parent rate-1/3 PCCC. The interleaver size is 1,000. 
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Fig. 2. Comparisson of upper bounds for various rate-1/2 NS-PCCCs and 
their parent rate-1/3 PCCCs. The interleaver size is 10,000. 



After substituting R-p> and R-p with 1/2 and 1/3 respectively, 
we find that a rate-1/2 NS-PCCC can achieve a lower upper 
bound on the BEP, over an AWGN channel, than its rate-1/3 
parent PCCC only if the effective free distance of the parent 
PCCC, dfree.eff, meets the condition 



rifre 



.eff 



> 6. 



(24) 



The contributions of the error events with weight 2 and 3, 
for the previous case, are examined in FigQ] We observe that 
up to a certain value of E b /N , the rate-1/2 PCCC( 1,5/7,5/7) 
exhibits a lower upper bound than its parent code. Note that 
for this range of Eb/N values, the inequality P'(2) < P{2) 
is satisfied. Although P(3) and P'(3) do not significantly 
affect the bounds at low E b /N values, they play an important 
role at higher E^/Nq values. However, for a larger interleaver 
size (e.g., TV = 10,000), P'(2) is dominant, as explained 
previously. More specifically, P'(2) determines the upper 
bound of the rate-1/2 NS-PCCC(l,5/7,5/7), which is always 
lower than the upper bound of its parent rate-1/3 PCCC for 
the range of E^/Nq values investigated, as we observe in Fig|2] 



(a) Rate- 1/3 PCCC( 1,5/7,5/7) 



(b) Rate- 1/2 NS-PCCC( 1,5/7,5/7) 



(c) Rate- 1/2 PS-PCCC( 1,5/7,5/7) 



Fig. 3. Extrinsic information transfer characteristics of iterative decoding for various turbo codes using an interleaver size of 10 6 bits. Two decoding averaged 
trajectories for each case are also plotted; one for an interleaver size of 10 3 bits and the other for an interleaver size of 10 6 bits. 



In Figf2] we also observe that in all cases except 
for PCCC( 1,2/3,2/3), the rate- 1/2 NS-PCCCs achieve better 
bounds than their parent PCCCs. The reason is that the free 
effective distance of the parent rate- 1/3 PCCC( 1,2/3, 2/3) is 
rffree.eff = 4, thus condition d24b is not met. For all other turbo 
codes investigated in Fig|2j df ree .eff > 6 holds true. 

V. Convergence Considerations 

The upper bound on the BEP for ML soft decoding provides 
an accurate estimate of the suboptimal iterative decoder 
performance at high E b /N values, for an increasing number 
of iterations [12]. Since the performance of rate-1/3 PCCCs 
gradually converges to the ML bound, this bound can be used 
to predict the BEP error floor region of the corresponding 
code. However, when puncturing occurs, we need to explore 
whether the performance of the iterative decoder eventually 
converges to the ML bound. For this reason, we use extrinsic 
information transfer (EXIT) chart analysis [15], which can 
accurately predict the convergence behavior of the iterative 
decoder for very large interleaver sizes (e.g., A=10 6 bits). 

An iterative decoder consists of two soft-input/soft-output 
decoders. Each decoder uses the received systematic and parity 
bits as well as a-priori knowledge from the previous decoder 
to produce extrinsic information on the systematic bits. Ten 
Brink described the decoding algorithm process using EXIT 
chart analysis [15]. To this end, the information content of the 
a-priori knowledge is measured using the mutual information 
I A between the information bits at the transmitter and the 
a-priori input to the constituent decoder. Mutual information 
Ie is also used to quantify the extrinsic output. The extrinsic 
information transfer characteristics are then defined as a 
function of I A and E b /N , i.e., I E = T{I A ,E b /N ). By 
plotting the mutual information transfer characteristics of both 
constituent decoders in a single EXIT chart, evolution of the 
iterative decoding process can be visualised. 

During the first iteration, the first decoder does not have any 
a-priori knowledge, thus Iai,i =0, while the second decoder 



uses the extrinsic output Ie 1} i = T (0, E b /No) of the first 
decoder as a-priori knowledge, i.e., Ia 2 ,i = Ie x ,i- The extrinsic 
output of the second decoder, Ie 2 ,i = T (Ia 2} i, E b /No), is 
forwarded to the first decoder to become a-priori knowledge 
during the next iteration, i.e., I Al ,2 — Ie 2 ,i, ar, d so on - Note 
that convergence to the (Ia,Ie) — (L 1) point, i.e., towards 
low BEPs, occurs if the transfer characteristics do not cross. 

As an example, we consider the rate-1/3 systematic 
PCCC( 1,5/7,5/7) to be the parent code. Fig pCaj] shows the 
transfer characteristics of the constituent decoders for the 
parent PCCC using an interleaver of size N = 10 6 . We 
see that for E b /No = 0.2 dB, the decoder characteristics 
do not intersect and the averaged decoding trajectory [15] 
manages to go through a narrow tunnel. Fig |3(b)| depicts the 
decoder characteristics for the rate- 1/2 NS-PCCC employing 
an interleaver of the same size. For E b /No = 1.0 dB, 
the averaged trajectory just manages to pass through a 
narrow opening, which appears close to the starting point 
(0,0). Therefore, for long interleavers, the performance of 
the suboptimal iterative decoder for the rate- 1/2 NS-PCCC 
converges towards the error floor region, defined by the upper 
bound, and eventually outperforms its rate-1/3 parent PCCC. 
However, convergence begins at a higher E b /No value and a 
larger number of iterations is required. 

In Fig |3(a)| and Fig |3(b)| the averaged trajectories for the 
more practical interleaver size of 1,000 bits are also depicted. 
For E b /N = 1.5 dB the trajectory for rate-1/3 PCCC quickly 
converges towards low BEPs. However, the trajectory for 
rate- 1/2 NS-PCCC dies away after 2 iterations, even for an 
E b /No value of 4.5 dB, due to the increasing correlations 
of extrinsic information. We attribute this problem to the 
absence of received systematic bits, which causes erroneous 
decisions. As a result, error propagation prohibits the iterative 
decoder from converging. Thus, for small and more practical 
interleaver sizes, the performance of rate- 1/2 NS-PCCC does 
not gradually approach the upper bound for ML decoding. 



To alleviate this problem, the turbo encoder could send 
some systematic bits, while keeping the rate equal to 1/2 
by puncturing some parity bits. In [9] we have presented 
a technique for deriving good punctured codes and we 
have identified a rate- 1/2 PS-PCCC that achieves the second 
best performance bound for ML decoding, after the rate- 1/2 
NS-PCCC. Fig |3(c)| shows the transfer characteristics of the 
constituent decoders as well as the averaged trajectory for 
N=10 6 . A comparison with Fig [3(b)] for the NS-PCCC case, 
reveals that a lower Eh/N is required and less iterations 
are needed, in order for the rate- 1/2 PS-PCCC to converge. 
Furthermore, the trajectory for an interleaver size of 1,000 bits 
reaches the top corner of the EXIT chart for the same E^/Nq 
as the parent rate- 1/3 PCCC, guaranteeing that the iterative 
decoder will converge towards low BEP values. 

VI. Simulation Results 

The process for selecting rate- 1/2 PS-PCCCs that lead to 
superior performance than their parent rate- 1/3 PCCCs can be 
summarized in two steps. We first implement the technique 
we have proposed in [9] to derive good punctured PCCCs 
that exhibit low error floors. We then use EXIT charts and 
averaged trajectories to identify the punctured PCCC whose 
performance converges towards the error floor region, when 
iterative decoding is used. 

We consider PCCC( 1,5/7,5/7) and PCCC( 1,7/5,7/5) to 
demonstrate the effectiveness of this process. The iterative 
decoder applies the BCJR algorithm [16] and performance 
is plotted after 10 iterations. A random interleaver of size 
1,000 bits is used. In Fig H] we see that the performance of 
both parent rate- 1/3 PCCCs coincides with the corresponding 
upper bounds for ML decoding, at high E^/Nq values. As 
expected, the performance of iterative decoding for rate- 1/2 
NS-PCCCs does not converge towards low BEPs, thus they 
do not outperform their parent codes, although they exhibit 
a lower upper bound. Nevertheless, rate- 1/2 PS-PCCCs that 
achieve a lower error floor than their parent rate- 1/3 PCCCs, 
can be found based on [9]. Note that, in both cases, the encoder 
of the selected rate- 1/2 PS-PCCC transmits 7 parity bits and 
only 1 systematic bit for every 4 input information bits. 

VII. Conclusion 

In this paper we have demonstrated that, if a certain 
condition is met over the AWGN channel, puncturing of the 
systematic output of a rate- 1/3 turbo code using a random 
interleaver leads to a rate- 1/2 non-systematic turbo code that 
achieves a better performance than its parent code, when ML 
decoding is used. In the case of iterative decoding, the absence 
of systematic bits makes convergence towards low bit-error 
rates difficult for the rate- 1/2 non-systematic turbo decoder. 
Nevertheless, we can assist convergence by transmitting some 
systematic bits, while keeping the rate 1/2 by puncturing more 
parity bits. Thus, we can combine the techniques described 
in [9] and [15] to identify good puncturing patterns, improve 
bandwidth efficiency by reducing the rate of a PCCC from 1/3 
to 1/2 and, at the same time, achieve a lower error floor. 
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Upper bound for rate-1/3 PCCC 

Upper bound for rate-1/2 NS-PCCC 
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- a- Simulation for rate-1/2 PS-PCCC (10 iterations) 

Fig. 4. Comparison between the upper bounds and simulation results for 
PCCCs using an interleaver size of 1,000 bits. 
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